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Abstract — The problem of simultaneous message transmission 
and state amplification in a Gaussian channel with additive 
Gaussian state is studied when the sender has imperfect non- 
causal knowledge of the state sequence. Inner and outer bounds 

to the rate-state-distortion region are provided. The coding 
scheme underlying the inner bound combines analog signaUng 
and Gelfand-Pinsker coding, where the latter deviates from the 
operating point of Costa's dirty paper coding. 

L Introduction 

Consider a Gaussian chaimel with additive Gaussian state 
in which the receiver simultaneously recovers a message 
communicated by the sender and estimates the state sequence. 
The sender facilitates this process by utilizing its own (possibly 
imperfect) knowledge of the state. 

This problem was first investigated by Sutivong et al. [1] for 
the case when the sender has perfect knowledge of the state 
sequence before transmission begins. The authors show that the 
optimal rate-state-distortion tradeoff is achieved by dividing the 
available fransmit power between analog state ttansmission and 
message transmission via dirty paper coding [2]. Subsequently, 
Kim et al. [3] considered the discrete memoryless version of 
this problem and characterized the tradeoff when the state 
reconstruction accuracy is measured by blockwise mutual 
information instead of quadratic distortion. 

In this work, we are interested in the case in which the state 
observation at the sender is not perfect, but is encumbered by 
additive Gaussian state observation noise. A generaUzation 
of the problem in [1], this setting can be understood as 
modeling the original state amplification system with imperfect 
processing components. It also applies to the relay channel (see, 
for example, [4]), where the relay node attempts to amplify the 
primary transmitter's signal of which it has obtained a lossy 
description through another route. 

Our setting contains several interesting extreme cases. When 
the state observation noise becomes negligible, our setting 
reverts to that of [1]. Conversely, the case when the state 
observation noise grows infinite, and thus the transmitter has 
no state knowledge, was studied in [5]. Pure state amplification 
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without message ttansmission was considered in a previous 
work by the second author [6J, where it was shown that an 
analog scheme with power conttol is optimal. By contrast, in the 
case of pure message ttansmission without state amplification, 
the optimal rate is achieved by dirty paper coding [2J with 
respect to the observable part of the state. 

In this work, we consider the general tradeoff between 
message ttansmission rate and state amplification accuracy. 
We propose an inner boxmd and two outer bounds to the 
rate-state-distortion region. The inner bound is obtained by a 
hybrid scheme of analog state signaling and Gelfand-Pinsker 
encoding, where the Gelfand-Pinsker code in general does not 
coincide with dirty paper coding [2], but instead requires an 
optimized coefficient choice. The first outer bound is derived 
by generalizing the noise-partition approach in [6], while 
the second outer bound follows from careful analysis of the 
correlation structure in the problem. 

In the following, we first provide a precise problem definition, 
before discussing the inner and outer bovmds in Sections III 
and IV. We omit some details of the proofs for brevity's 
sake. Numerical examples and concluding remarks are given 
in Section V. Our mathematical notation follows [4]. 

II. Problem definition 

Consider the state-dependent memoryless channel with input 
Xj e M for i = 1, 2, . . . and output 

Yi = Xj, -\- Si -\- Zi, 

where {Si\ and {Zi] are additive i.i.d. state and noise 
sequences, respectively, disttibuted according to Si ~ N(0, Q) 
and Zi N(0, N). The channel input is subject to an average 
power consttaint P. The sender has non-causal access to the 
noisy state observation 

= 5, + (7„ 

where {Ui} is an i.i.d. state observation noise sequence 
distributed according to Ui ~ N(0,cr2). We assume that {Si}, 
{Zi}, and {Ui} are independent. 

The sender aims to communicate a message M at rate R 
reliably to the receiver. In addition to recovering the message, 
the receiver is also interested in obtaining an estimate 5" of 
the state sequence 5", with state distortion measured by the 
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Figure 1. State amplification with noisy state observations. 



Figure 2. Equivalent system model. 



average squared error and upper-bounded by D. The setup is 
depicted in Figure 1. 

Formally, a (2"^, n) code for the Gaussian state amplifi- 
cation channel with noisy state observations consists of an 
encoder that maps a message m e {1 : 2"-"} and a state 
observation G M" to a transmit sequence x" G M" and 
a decoder that maps the received sequence € K" to 
a message estimate to e {1 : 2"^} and a state estimate 
s" S M". We assume the message is random according to 
M ~ Unif{l : 2"^} and restrict our attention to codes that 
satisfy X]"=i ^[^F] < -P- A rate-state-distortion pair 

{R, D) is said to be achievable if there exists a sequence 
of (2"^,n) codes such that lim„_^oo P{M M} = and 
limsup„^^ (1/n) X;r=i ^(5"; - S',)^ < D. We are interested 
in characterizing the rate-distortion region, i.e., the closure of 
the set of achievable (i?, D) pairs. 

Before we begin our discussion, it is helpful to reformulate 
the problem as follows. Since the triple {Si, Ui, Vi) is jointly 
Gaussian, we can equivalently write 

with V,^^ Q/{Q + al)V, - N(0,Q') and W, - N(0,7V')- 
Here, {Vi} and {Wi] are independent i.i.d. Gaussian sequences 
with variances 



Q' = 



N' 



This equivalent system model is depicted in Figure 2. Note that 
the channel state S*" is decomposed into a perfectly observable 
part and a completely unobservable part VF". However, 
the receiver still aims to estimate the entire state V"^ + VF". 

III. Inner bound 
For a constant /3 e [0,1], let 



5 = v/(l-/3)W, 
(l+g)g' + iV'" 
a(l+5)Q' ' 

(1+(7)2Q' + /3P + AT' - 
/3F + a(l+5)2Q' 



E = 



/3P + a(l+5)2Q'' 
/3P + a2(l+5)2Q' 



(1) 
(2) 



Then we have the following inner bound to the rate-state- 
distortion region. 

Theorem 1. The rate-state-distortion (P, D) is achievable if 



P < i log 



ffP(/jP+(l+g)^Q'+JV'+Af) 



D > 0' + iV' -r'^S^V, 
for some a e M+, /3 e [0, 1] 



7, (3) 
(4) 



Proof: Consider the following coding scheme, in which 
the transmit signal consists of a scaled version of the channel 
state sequence and a Gelfand-Pinsker codeword matched to 
the amplified state sequence. More formally, we generate a 
codebook as follows. 

Codebook generation: Fix a and (3. Let X ^ N(0, /3P) be 
independent of the state V, and U — X + a{l + g)V . Define 
an auxiliary rate R> R. For each message to € {1 : 2"^}, 
generate a subcodebook C(to) consisting of 2"(^~^) sequences 
u'^{m, I), for Z e {1 : 2"(^^^)}, each independently generated 
according to nLiPt'("0- 

Encoding: Fix e' > 0. To communicate message to given 
the state sequence w", the sender finds an index I such that 
(u"(to,0,w") e T^'''\U,V), and transmits 

a^i = gvi + ii, for i G {1 : 

where = Ui{m, l)—a{l+g)vi. Observe that by construction, 
the sequence i" is jointly typical with the state sequence 
?}", that is, symbolwise pairs {xi,Vi) are asymptotically 
independent. Therefore, the average power constraint P is 
satisfied. 

Decoding and analysis of the probability of error: Observe 
y". Let £ > e'. Declare that message rh has been sent if (to, I) 
is the unique index pair such that 

K(TO,0,y")er,("). 

By the result of Gelfand-Pinsker for channels with state [7], 
the probability of decoding error vanishes as n — > oo if 

R < I{U;Y) - I{U;V). 

To evaluate the terms, recall that 



Y = {l+g)V + X + W + Z, 
U = X + a{l + g)V, 



(5) 
(6) 



where V, X, W, and Z are independent Gaussians of variances 
Q', (3P, N', and A''. It is not hard to see that the rate condition 
evaluates to (3). 

Estimation and analysis of estimation error: For each symbol 
time i E {1 : n}, construct the best MSB estimate of .s^ given 
the observations yi and Ui{rh, I), where m and I are the decoded 
message and subcode index, respectively. Omitting the time 
index, recall (5), (6) and 



s = v + w, 

Hence the joint distribution of {S,Y,U) is 



(7) 



N 0, 



y + N' r^' 
r S 



where r and E are shorthand for the cross-correlation vector 
between S and [Y, U], and the autocorrelation matrix of [1^, i7], 
respectively, and are given in (1) and (2). The best estimate is 



Ui{m,i) 



(8) 



and the mean square error satisfies (4). This concludes the 
proof of Theorem 1 . ■ 

Remark 1. Recall that in Costa's dirty paper coding [2], the 
parameter a is chosen as 



a = 



I3P + N' 



(9) 



It tums out that varying a as in the theorem achieves a larger 
inner bound in our setting. 

Remark 2. The estimate Si in (8) is independent of Ui when 
the second component of r^E" 



is zero. 



il+g)Q' + N'' 
a{l + g)Q' 



-ffP-ail + gfQ') 
{l+gfQ'+^P + N' + N 



= 0, 



which occurs when 



a 



[3P{{l + g)Q' + N') 
{l+g)Q'{l3P + N-gN') 



(10) 



At all other values of a, Ui is useful in estimating Sj. As a 
side note, observe that if there is no state observation noise 
(when N' = 0), (10) reduces to (9). 

Remark 3. Numerical computations indicate that the inner 
bound in Theorem 1 cannot be improved by (1) reducing the 
gain g, (2) using part of the message rate to send a digital 
description of V", or (3) diverting a fraction of power to send 
an additional message by superposition coding. 



IV. Outer bounds 

We present two outer bounds to the rate-state-distortion 
region. Recall A = Q/{Q + cr^). 



Theorem 2. If a rate-state-distortion pair {R, D) is achievable, 
then for all N e [0, N], there exists an f e [0, y/P{Q + cr^)] 
such that 



R<-lo: 



{Q + <tI){P + N + Es) 



£>>( 1-1-2 
where 



{Q + al){N-N) 
2R Q{N + 'ylKN-N) 



Es 



NaliP + Q + N + 2Xf) 
QNal 



Es, 



(11) 
(12) 



QN + Qal + Nal' 

Proof: Following [6], let us divide the noise Zi into two 
independent components Zi and Zi, with 

-N(0,iV), 
Zi ~ N{0,N-N). 

Note that Es, as defined in the theorem, denotes the mean 
square error of the best linear estimator of Si given Vi = Si+Ui 
and Si + Zi. Define the quantity 

A= i7(y",5"-h^";y"). 

Using results from the remote source coding problem in rate- 
distortion theory, it was shown in [6] that the information 
measure A and the quadratic distortion D are related as 

"^-''""^[NaliD/Es-l) 



or equivalently, 

D>(l + 2-2^ 



Q{N 



Nal 



Es- 



(13) 



This allows us to translate upper bounds on A to lower bounds 

on D. Next, we obtain an outer bound on the achievable {R, A) 
region. First, it follows from Fano's inequality that 

nR = H{M) 

= ff(M|y",5" + Z") 

< 7(M; y" I F", 5" Z") + nen 

= /i(y"|y",S'"-hl")-/i(l")-Fn£„. (14) 



Let 



1 " 

^"=^E|E(W)|. 



(15) 



Using covariance matrices to boimd differential entropies, it 
can be shown that 

< f log(2^e(P+Q+iV+2Af)), (16) 

^.(y"!^",^"-^^") < ^\og{2TTe{P + N + Es 

-rViQ + c^l)))- (17) 

Substituting these inequalities and the definition of A into (14), 
we conclude that A) must satisfy (11) and 



A < i log 



P + Q + N + 2\f 
N -N 



R 



as n ^ 00. Using the last inequality with (13), we obtain (12). given S^. Hence 
Finally, note that f e [0, y^P{Q + cr^)] since 



(a) 
f < 



(b) 
< 



\ 



1 " 



i=l 



-J2E{Xf){Q + al) 



(c) 



where (a) follows from the generalized mean inequality, (b) 
follows from the Cauchy-Schwarz inequality, and (c) follows 
from the power constraint. This concludes the proof of the 
outer bound in Theorem 2. ■ 

In order to state the second outer boimd, we define the 
function / as 

fix) = (x/S - ^fWjQ' ^Q^x)\, 

where a;+ denotes the positive part max{a;, 0}. It can be shown 
that / is convex and non-decreasing. 

Theorem 3. If a rate-distortion pair (i?, D) is achievable, then 
it must satisfy 

^-2^°^ (Q + a2)(iv + ^') ' ^^^^ 



Q'{N + N') 



(19) 



^P + Q + N + 2Xf 

for some f e [0, ^/P{Q + al)]. 

Proof: Let A' = To relate A' and the 

distortion D, note that 

(a) 

A' > i/(F";S'") 

n 

i=l 

n 

> ^h{V") - 2^ ^log(27reVar(i>, | S^)) 

i=l 

(b) " 

> - i log(27re • i 5^ Var(V; | S,)) 
>^MV^")-ilog(2.e.i^D;) 

n 

= ^iog(g')-iiog(i^i?^), 

where (a) follows from the data processing inequality, (b) 
follows from Jensen's inequality and (c) follows from defining 
D'^ to be the mean square error of best linear estimator of Vi 



(20) 



Let Di = Var(S'i — Si) be the mean square instantaneous state 
estimation error at the receiver at time i. In Appendix A, we 
use the Cauchy-Schwarz inequality to show 



Thus, 



A > f{D'i). 



D = iY.D.>iY.m) 



i=l 



i=l 



(a) 



(b) 



> f{Q' ■ 2-2^'), 



(21) 



where (a) follows from Jensen's inequality and (b) follows 
from (20). 

Next, we obtain an outer bound on the achievable [R, A') 
region. From Fano's inequality, we have 

nR = H{M I F") 

< I{M; F" I F") + nen 

= /i(F"|F")- /i(y"|F",M) +n£„. (22) 

^ V ' 

= f log(27re(iV'+iV)) 

Reusing definition (15), and using covariance matrices to bound 
differential entropies, it can be shown that 



/i(y"|I/") < f log(27re 



al{N+P+Q) + Q{N+P) - r 



Substituting this inequahty, bound (16) and the definition of 
A' into (22), we obtain (18) and 



A' < i log 



P + Q + AT + 2Af 



R 



as n — > oo. Using the last inequality with (21) yields (19), 
which concludes the proof of Theorem 3. ■ 

V. Numerical examples and Concluding remarks 

Two examples for the inner bound of Theorem 1 and the 
outer bounds of Theorems 2 and 3 are depicted in Figures 3 
and 4. In the example in Figure 4, the transmit power P 
is sufficiently large to permit a nonzero rate at the minimum 
distortion value. This is the case where the optimal transmission 
scheme without a message (R = 0) as discussed in [6] uses 
less than the full transmit power. 

We observe that the outer bounds complement each other, 
but exhibit a nonneghgible gap from the inner bound. To close 
this gap, new outer bounding techniques will be necesseiry, the 
study of which is the subject of future research. 
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Figure 3. Bounds to the rate-estimation-error region, parameters 
Q = 10, N = 1, al = 1, and P = 7.7 (i.e., Q' = 9.09, N' = 0.91). 
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Figure 4. Bounds to the rate-estimation-error regions, parameters 
Q ^ 10, N ^ 1, al ^ 1, and P = 77 (i.e., Q' = 9.09, N' = 0.91). 



Appendix 
A. Relation between Di and D[ 

Let Ei = S, - S, and recall A = Var(5j - Si) = Var(£;,). 
Likewise, let Vi be the best linear estimator of Vi given Si, 
define the corresponding estimation error as Fi — Vi — Vi and 
recall D[ = Var(F,). 

By the orthogonality principle, we have E(FiVi) = 0, and 
using E{Vi) = Q', it follows that 

E{VV) = E(t//) = g' - D[. 

Since is a scaled version of S";, the variance Di is lower 
bounded by the mean square error of the best linear estimator 
of Si given Vi, namely 



To evaluate the expectation, consider 

O' - D' ~ 



(23) 



where the first term in the sum is the best linear estimator 
of Vi given V, and F/ is the corresponding estimation error. 
Thus, Vi and F/ are uncorrected and 



VariF:) = Q' -D[ 
Furthermore, recall 



Q' 



Q' 



s,=^v + w,, 

where Vi and Wi are independent and Var(Wi) ~ N'. Thus, 



EiVA) = E 



V + Fl] iv + w,) 



^Q'-D[ + E{FlWi). 
By the Cauchy-Schwarz inequality, 

\E{FlW,)\ < yECFf)E(Wf) 



(24) 



lN'D[{Q'-D[) 



V Q' 

Substituting back into (24) and using D,- < Q', this implies 



\E{VS^)\ < Q' - Di 



^N'D[{Q'-D[) 



Q' 



D,>Q' + N'- 



N'D[{Q'-D[) 

Q' 



Further, substituting back into (23) yields 

Q' - D', - 

Q' - D[ 

-fiD'i), 
which concludes the proof. 
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